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CROSS-REFERENCES TO RELATED APPLICATIONS 
This application is a continuation of U.S. application serial number 
09/567,250, filed May 9, 2000, which is hereby incorporated herein by reference 
m its entirety, and which is a continuation of 09/193,459, filed November 16 
1998, which claimed the benefit of U.S. application serial number 60/088 149 
filed June 5, 1998. ' ' 

STATEMENT AS TO ANY INVENTION RIGHTS UNDER FEDERALLY 
SPONSORED RESEARCH 

Not applicable. 

BACKGROUND OF THE INVENTION 
The present invention relates generally to the field of advertising systems 
and more particularly to the field of Internet advertising. 

The worldw.de network of computers connected through the Transmission 
Control Protocol/lnternct Protocol (TCP/IP) communications standard, commonly 
known as the Internet, has seen explosive growth during the last several years 
Thts growth has been fueled in part by the introduction and widespread use of so- 



called "web" browsers, which allow for simple graphical user interface (GUI) 
access to network servers, which support documents formatted as so-called web 
pages. The World Wide Web (WWW), or "web", is a collection of servers on the 
Internet that utilize a Hypertext Transfer Protocol (HTTP), which is an application 
protocol that provides users access to files (which can be in different formats such 
as text, graphics, images, sound, video, etc.) using a Standard Generalized 
Markup Language (SGML), which is an information management standard for 
providing platform-independent and application-independent documents that 
retain formatting, indexing, and linking information. SGML provides a grammar- 
like mechanism for users to define the structure of their documents and the tags 
they will use to denote the structure in individual documents. The page 
description language known as Hypertext Markup Language (HTML) is an 
application of SGML. HTML provides basic document formatting of text and 
images and allows the developer to specify hyperlinks, or "links," to other servers 
and files. Use of an HTML-compliant client, such as a web browser, involves 
specification of an address via a Uniform Resource Locator (URL). Upon such 
specification, the client makes a TCP/IP request to the server identified in the 
URL and receives a "web page" (namely, a document formatted according to 
HTML) in return. 

Electronic mail (E-mail) is another important part of online activity. 
Conventional e-mail is the exchange of text messages and computer files over a 
communications network, such as a local area network or the Internet, usually 
between computers or terminals. Routing of e-mail on the Internet is typically 
accomplished through the use of a protocol for sending messages called the 
simple mail transfer protocol (SMTP). Multipurpose Internet mail extensions 
(MIME) extend SMTP to permit data, such as video, sound, and binary files, to be 
transmitted by Internet e-mail without having to be translated by the e-mail client 
into ASCII format. This is accomplished by the use of MIME types, which 
describe the contents of a document. A MIME-compliant client application 
sending a file, such as one of various conventional e-mail programs, assigns a 



MIME type to the file. The receiving application, which must also be MME- 
compliant, refers to a standardized list of documents that are organized into 
MIME types and subtypes to interpret the content of the file. MIME is part of 
HTTP, and both web browsers and HTTP servers use MIME to interpret e-mail 
files they send and receive. Post Office Protocol 3 (POPS) is a recent version of a 
standard protocol for receiving e-mail. POP3 is a client-server protocol in which 
e-mail is received and held in a mailbox for a user by a network server. 
Periodically, the end user checks the mailbox on the network server and 
downloads any e-mail. An alternative protocol is Interactive Mail Access 
Protocol (MAP), according to which a user views e-mail at the server as though it 
was on the user's computer, and an e-mail message deleted locally is still on the 
server. Thus, POP3 can be thought of as a "store-and-forward" service, while 
MAP can be thought of as a remote file server. Therefore, an e-mail message is 
typically sent with SMTP, and after a network server receives the e-mail message 
on the end user recipient's behalf, the e-mail message is typically read by the end 
user using POP3 or MAP. 

In addition to older basic e-mail systems, including basic ASCII e-mail 
clients using SMTP and POP3, some enhanced e-mail clients, such as Eudora Pro 
Email v. 4.0, display HTML portions of messages according to HTML formatting 
contained in the e-mail message bodies. Also, web-based e-mail systems, such as 
are currently offered by Hotmail™ and Yahoo™, are accessible through web 
browsers. In those systems, e-mail messages are formatted into web pages, or 
portions thereof, for formatted viewing control through web browsers. Thus, 
plain text e-mail messages received by those web based e-mail systems are 
converted into web pages for viewing by web browsers. 

Shared public message networks include Usenet Newsgroups, Internet 
Relay Chat, Fidonet, RIME, ILINK, and a host of others. Public message 
networks also include public message areas in proprietary online systems. Most 
are normally set up according to separate general interest categories (e.g., 
"conferences," "forums," or "newsgroups"), subjects within those categories (e.g., 



"subjects," "topics," or "threads"), and finally individual messages or postings 
within each subject, typically arranged chronologically, as well as according to 
earlier messages to which they respond. Also included in this category of public 
messaging are instant messaging programs, which allow users to communicate 
publically with other users in real time. These conferences typically are carried by 
many online systems regionally, around the country, or even around the world. 
Newsgroups also have an Internet protocol which governs their transmission 
called network news transfer protocol (NNTP). As with e-mail clients, public 
messages are also accessible through web browsers, enhanced public messaging 
clients capable of displaying HTML formatting, and basic ASCII clients. 

The recent growth of information applications on international public 
packet-switched computer networks, such as the Internet, suggests that public 
computer networks have the potential to establish a new kind of open marketplace 
for goods and services. As web pages, discussion forums and e-mail 
communications are used more nationally and internationally, it is highly desired 
that manufacturers and merchants be able to non-offensively advertise their goods 
and services to users during their regular course of Internet activity. With only 
limited success, such advertising has been done through the use of images as well 
as text transferred over the Internet. Advertisements transferred over the Internet 
often, but not always, make use of trademarks. A "trademark" is a word, design, 
color, sound, smell, etc., or any combination thereof, used by a manufacturer or 
merchant to identify their goods and/or services and distinguish them from others. 
In general, advertisements include most types of communications promoting 
goods and/or services of organizations or individuals, as well as promoting the 
organizations or individuals themselves. Entities with access to potential viewers 
of advertisements often charge a fee to other entities interested in advertising 
themselves and/or their goods and/or services. 

On the Internet, as in more traditional venues of advertising, such as 
billboards, TV commercials, products, etc., most advertisements (ads) include 
promotional material intended to be used to interest consumers with particular 



goods or services. Currently, one primary way to advertise on the Internet is 
through ad banners, which often contain static or animated images, with or 
without trademarks, and normally advantageously function as hyperlinks to 
advertisement owner web pages. Unfortunately, banner ads often disappear with 
scrolling by the user and take up precious screen space. Furthermore, because of 
typically large graphical content, banner advertisements are often slow in 
downloading. As a result, users often move down a web page or to another web 
page and do not wait for advertisements to complete the downloading process if 
text or other content is displayed before, or simultaneously with, the 
advertisements, thereby clearly diminishing the impact of the advertisements. If 
text or other content is displayed only after an advertisement is completely 
downloaded, users may become very frustrated with the owner of the 
advertisement if the wait time is prolonged. Interstitial displays, such as splash 
screens which appear in between web page requests and before a web page is 
actually delivered, also provide advertisement opportunities, but they are often 
extremely brief, thereby greatly lessening their effect. 

Others have addressed the problem of getting advertisements to an end 
user through the use of screensavers, such as a product commercialized by 
PointCast, Inc., Sunnyvale, California, as described in U.S. Patent No. 5,740,549 
to Reilly, et al. Although the Screensaver program approach does appear to be 
capable of communicating advertisements to some users, there are clearly 
disadvantages to displaying these advertisements in an area outside of the normal 
user work area during times of inactivity when a user may typically not be looking 
at the display. In addition, the extra steps required to install and update such 
software can be too complicated or cumbersome for some users. Advertisers also 
have used broadcast e-mails and public postings to send advertisement messages 
from themselves containing plain text, as well as HTML formatting for more 
effective display. In general, e-mail messages and public postings containing 
hyperlinks pointing to additional information are also known, such as described in 
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US. Patent No. 5,790,793. Unfortunately, users often immediately delete 
unsolicited e-mail messages, as well as those sent from unknown senders. 

Outside the Internet, top of mind awareness (TOMA) advertising acquaints 
the public with advertisers' brand-names, logos, trademarks, etc., through 
se.ec.ive infi.fration and saturation in the market. The purpose of such advertising 
is not to compel immediate purchase, but to enhance public awareness of the 
availability of the product from a particular manufacturer or merchant, so that 
when shoppers are at the retail markets to make purchases, they win recognize 
brands and immediately have higher perceived values of those products in relation 
to hke products by other manufacturers or merchants. The key to a TOMA 
campaign is repetition since the more times mat an individual is exposed to a 
particular brand-name, logo, trademark, etc., the more likely that individual win 
buy a particular product when making a buying decision in the future. 
Unfortunately, on the Internet, TOMA advertising is rarely accomplished 
successfully since, as discussed above, most conventional Internet advertising 
methods often result in very limited exposure to users. This conclusion is 
evidenced by the attention brokerage system described in U.S. Patent No 
5,794,210, which actually teaches a method of compensating users for paying 
attention to advertisements on the Internet. 

There is, therefore, a need for an advertising system for addressing these 
and other needs and problems. 

BRIEF SUMMARY OF THE INVENTION 
An advertisement system and method are provided for inserting into an 
end user communication message a background reference to an advertisement In 
some preferred embodiments of the present invention, the background reference 
causes an advertisement image to be tiled, or watermarked, across an end user 
screen behind the text of an e-mail message or public posting. A message server 
mserts the background reference after receiving a message original* sen. from an 
end user originator and before sending the message to be delivered to an end user 



recipient. When necessary, the message server will convert at least a portion of 
the message into a proper format, such as HTML, before inserting the background 
reference to an advertisement, which is preferably selected in accordance with end 
user recipient demographic information and/or ad exposure statistics. The 
advertisement itself, often a graphical file, is preferably not transmitted with the 
message in some preferred embodiments of the invention, but is typically stored at 
the message server or other location remote from the end user recipient. In some 
embodiments, the message server will also maintain and refer to records on each 
end user recipient to allow for selective enablement of background reference 
insertion and overwriting based upon end user preferences. According to various 
"non-web" example embodiments, the message server receives an SMTP or 
NNTP message and transmits an SMTP, POPS or NNTP message with an HTML 
portion for a respective HTML-compatible client. In other "web-based" 
embodiments, the message server transmits the entire message in HTML to be 
used as a stand-alone web page or as a portion of a larger page employing frames 
or tables. 

Since the advertisement is placed in the background when viewed by a 
user, it is normally non-clickable, i.e. , not a hyperlink to another HTML page. 
While this novel system of advertising is unusual since a typical user may initially 
desire, as with conventional banner advertisement, to click on the background 
image to go to another web page owned by the advertiser for more information or 
for ordering a product, the user will often be exposed to the tiled advertisement 
longer, and many times subliminally, while reading the content of the message, 
and the user may also be initially surprised to see an advertisement in the 
background of an e-mail message which may be from a known originator, thus 
increasing the awareness and exposure. Background images may also be very 
small in comparison to banner advertisements, thus downloading relatively 
quickly. While the scope of the present invention is also intended to include 
inserting a reference to any type of background image or graphic, including non- 
advertisements, the method of inserting a reference to an advertisement is 



considered particularly useful and beneficial in view of the above unexpected 
advantages, among others. In addition, Internet service providers, web site 
owners, e-mail service providers, newsgroup services and other end user 
commumcation providers are able to extract revenue for non-obtrusive advertising 
on 100% of the active screen area while still providing a work area for users to 
perform desired tactions. In addition, this display does not necessarily affect 
current advertisement banners being displayed. Other feamres and advantages of 
vanous preferred embodiments of the present invention will become apparent to 
one wtth skill in the art upon examination of the following drawmgs and detailed 
description. 

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS 
The accompanying drawings incorporated in and forming a part of the 
specification illustrate several aspects of the present invention, and together with 
the description, serve to explain the principles of the invention. 

FIG. 1 is a block diagram illustrating physical components of one 
implementation of the present invention. 

FIG. 2 is a block diagram illustrating one type of end user workstation in 
accordance with one preferred embodiment of the present invention. 

FIG. 3 is a block diagram illustrating one type of network server in 
accordance with one preferred embodiment of the present invention. 

FIG. 4 is a flowchart showing general operation steps of the background 
reference system of the present invention in accordance with one preferred 
embodiment. 

FIG. 5 is a flowchart showing the operation of one implementation of a 
background reference insertion process of FIG. 4. 

FIG. 6 is an illustration of selected basic components of an example end 
user e-mail communication message as sent by an end user originator, in 
accordance with one preferred embodiment of the present invention. 



FIG. 7 is an illustration of the end user e-mail communication message of 
FIG. 6 converted completely into HTML for use in a web-based e-mail 
implementation of one preferred embodiment of the present invention. 

FIG. 8 is an illustration of the message of FIG. 7 with an inserted 
advertising background reference. 

FIG. 9 is an illustration of a screen display of the message of FIG. 8. 
FIG. 10 is a flowchart showing the general operation of another preferred 
embodiment of the present invention in a non-web-based, SMTP/POP3 
implementation of a background reference system accommodating an e-mail 
message with an attachment. 

FIG. 1 1 is an illustration of selected basic components of an example end 
user e-mail communication message that is not in MIME format and that has an 
attachment, in accordance with the preferred embodiment of FIG. 10. 

FIG. 12 is an illustration of an example message similar to that of FIG. 1 1 
converted into MIME format. 

FIG. 13 is an illustration of an example message similar to that of FIG. 12 
converted into a multipart/alternative part MIME format with an HTML part 
including a background reference. 

FIG. 14 is an object model diagram showing portions of one 
implementation of an advertising system in accordance with one preferred 
embodiment of the present invention. 

FIG. 15 is a flowchart showing a configuration process of the advertising 
system implementation portion represented by FIG. 14. 

FIG. 16 is a flowchart showing selected e-mail processing steps of the 
advertising system implementation portion represented by FIG. 14. 

Reference will now be made in detail to the description of the invention as 
illustrated in the drawings. While the invention will be described in connection 
with these drawings, there is no intent to limit it to the embodiments disclosed 
therein. On the contrary, the intent is to cover all alternatives, modifications and 
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equivalents included within the spirit and scope of the invention as defined herein 
and by the appended claims. 



DETAILED DESCRIPTION OF THE INVENTION 
Turning now to the drawings, wherein like reference numerals designate 
corresponding parts throughout the drawings, FIG. 1 is a block diagram 
illustrating physical components 10 of one implementation of the present 
invention, which has flexibility, expandability, and platform independence. White 
system configuration can take many forms in accordance with scope of the present 
mvention, the diagram of FIG. 1 illustrates a plurality of end user workstations 1 1 
12, 13 and 1 4 directly connected to networks 18 and 19, acceptable examples of 
whtch include, among others, local area networks (LANs) and Intranets. 
Additional workstations 20, 22 are remotely .ocated and in communication with 
the network 1 8 through a remote access network 24. Network servers 26, 28, and 
30, one or more of which are capable of functioning as a message server to 
perform the background reference insertion methods in accordance with the 
present invention, as discussed below, are shown connected to each other through 
an Internet 32, with conventional routers and switches omitted for clarity, but 
understood by those reasonably skilled in the art of the present invention. Such 
network servers are configured to support one or more conventional 
communication protocols, including, but not limited to, SMTP, POP3 IMAP 
NNTP, HTTP, etc. Of course, the elements of FIG. 1 are understood to be " 
representative of multitudes of similarly connected components, and various types 
of conventional workstations are understood to be connected to the Internet 32 
through conventional schemes. 

In one application of the physical components 10, one end user 
organization owns and maintains the components directly connected to network 
18, and another end user organization owns and maintains the components 
directly connected to network 1 9. In that application, the network server 28 can 
be configured to insert background references into end user communications 
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originated and received by any of the workstations 11, 12, 13, 14,20,22. For 
example, if an end user at workstation 20 sends an e-mail message to an end user 
at workstation 12, such a message could be routed through network server 26, 
network server 28 for background reference insertion, and then network server 30. 
Though not necessary, such routing could be prompted by the end user at 
workstation 12 maintaining an e-mail mailbox on network server 28. In another 
of the many applications of the physical components 10 included in the scope of 
the present invention, network server 26 is maintained by an Online Service 
Provider (OSP) to provide OSP customers using workstations 20, 22 access to the 
Internet 32, including e-mail mailboxes and access to the web and public 
messaging. In one example use of such an application, e-mail messages or public 
postings originated and/or received by an OSP customer would include 
background references inserted by network server 26, including those from and/or 
to other customers of the OSP and others outside the OSP, as configured by the 
OSP. As with the former application, OSP customers may also maintain 
mailboxes on network server 28. Clearly, these applications are merely examples, 
and other applications of the physical components 10 are also contemplated such 
that any network server is capable of functioning as a message server to perform 
the background reference insertion method of the present invention, as discussed 
below, without regard to whether mailboxes or user accounts are maintained by 
the message server. 

Refer now to FIG. 2, which is a block diagram illustrating one type of end 
user workstation 1 1, in accordance with one preferred embodiment of the present 
invention. A local interface 38, such as a conventional computer bus, is shown 
connected to a variety of components, including a storage unit 40, a processor 42, 
an input device interface 44 providing an interface to the local interface 38 for a 
conventional keyboard 46 and mouse 48, a display 50 for displaying information 
for being viewed by a user, a modem/network interface 55 for providing 
connectivity to other computers and networks, and memory 95. One example, 
among others, of an acceptable storage device 40 is a conventional hard drive, 
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which is used for non-volatile storage of programed other data which are 
loaded into memory 95 for operation of the workstation 1 1 and used by processor 
42 to control operation of the workstation 11. Such programs (also referred to as 
applications, systems, software, etc.) typically include, among others, an operating 
system 96, a browser client 52, ane-matl client 53, and a public posting client 54 
Examples of acceptable operating systems 96 include, a m ong others, Microsoft® 
Wmdows® and Unix. Examples of acceptable browser clients 52 include among 
others, Microsoft® Internet Explorer and Netscape Navigator. One example 
among others, of an acceptable e-mail client is Eudora Pro Email v4 0 One ' 
example, among others, of an acceptab.e public posting Cent 54 is Microsoft® 
Outlook Express, which also functions as an acceptable e-mail client. Some web 
browser clients also function as non-web-based newsgroup and e-mail clients 
thus also serving as enhanced readers of NNTP and P0P3 information. Of 
course, the scope of the present invention is intended to include, but no. be limited 
to, any client capable of displaying end user information with a definable 
background from any type of electronic feed, including but not limited to, web 
pages, e-mail messages, public postings, etc. 

Referring back to FIG. 1, one example implementation and application of 
the present invention includes the network server 28 fimctioning as a message 
server for inserting advertisement background references into end user messages 
Refer now to FIG. 3, which shows a block diagram representation of selected 
elements of one type of network server 28, which is shown including hardware 
elements similar to those of the example workstation 1 1 shown in FIG 2 For 
example, a local interface 138, such as a conventional computer bus, is shown 
connected to a variety of components, including a storage unit 140, a processor 
142, an input device interface 144 providing an interface to the local interface 138 
for a conventional keyboard 146 and mouse 148, a display 1 50, a modem/network 
interface 160 for providing connectivity ,„ other computers and networks, and 
memory 195. One example, among others, of an acceptable storage device 140 is 
a conventional hard drive, which is used for non-volatile storage of software 
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programs and other data which are loaded into memory 1 95 for operation of the 
network server 28 and used by processor .42 to control operation of the network 
server 28. However, the network server 28 executes software programs (also 
referred to as app.ications, systems, software, etc.) which are different from those 
of the workstations. For example, in accordance with one tmplementation 
software executed by the network server 28 executes a web server 152 e-mail 
server 153, public posting server 154, such as a newsgroup server, and 
background reference system 155. In other implementations, network server 28 
executes background reference system 155 in combination with one or more of 
me web server 152, public posting server 1 54, e-mail server ,53, or other end user 
message server software. In addition, while one indentation of the present 
mvention includes separate background reference system 155 which 
communicates with one or more end user message server software programs 
other unp.ementations include integrated end user message software solutions 
wmch dtrectly incorporate the functionality of the background reference system 



In addttion, the background reference system 1 55 of the present invention 
can be implemented in hardware, software, firmware, or a combination thereof ln 
one preferred embodiment, the background reference system 1 55 is implemented 
m software or firmware that is stored in a memory and that is executed by a 
su.table mstruction execution system. The background reference system 155 
whtch comprises an ordered listing of executable instructions for implementing 
logical functions, can be embodied in any computer-readable medium for use by 
or m connection with an instruction execution system, apparatus, or device, such 
as a computer-based system, processor-containing system, or other system tha, 
can fetch the instructions from the mstruction execution system, apparatus or 
dev.ce and execute the instructions. Examples, among many others, of acceptable 
software tmplementation environments include Java, Javascript, C++ etc In the 
context of this document, a "computer-readable medium" can be anymeans that 
can contam, store, communicate, propagate, or transport the program for use by or 
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in connection with the inaction execution system, apparatus, or device The 
computer readable medium can be, for example bu, no, limited to, an electronic 
magnenc, optical, electromagnet*, infrared, or semiconductor system, apparatus 
dcv.ce, or propagation medium. More specific examples (a nonexhaustive lis,) of 
the computer-readable medium would include the following: an electrical 
connection (electrode) having one or more wires, a portable computer diskette 
(magnefc), a random access memory (RAM) (magnetic), a read-only memoty 
(ROM) (magnetic), an erasable programmable read-only memory (EPROM or 
Flash memory) (magnetic), an optical fiber (optical), and aportable compact disc 
read-only memory (CDROM) (optical,. Note mat the computer-readable medium 
could even be paper or another suitable medium upon which fa program is 
primed, as the program can be electronically captured, via for instance optical 
scannmgof the paper or other medium, men compiled, interpreted or otherwise 
processed in a suitable manner if necessary, and then stored in a computer 
memory. 

Refer also to FIG. 4, which is a flowchart showing genera! operation steps 
300 of the background reference system 155 of the present invention in 
accordance with one preferred embodiment The background reference system 
155 recetves an end user communication message in step 304, such as, for 
example, through an SMTP or NNTP gateway from the Internet 32 (FIG 1) 
through a POP3 or IMAP mailbox, or through any other communication 
connection method for intercepting or otherwise accessing an end user 
communication message sent toward a, leas, one end user recipient from an end 
user originator. The background reference system 155 determines if the received 
message is in a format, such as HTML as one example, that can accept a reference 
to a backed, such as an advertising image as one example. If the message is 
not m such a format, such as plain text as one example, the message is converted 
mto an appropriate forma, to accept a background reference, as indicated in step 
308. If the message is already in such a format, or after the message is converted 
mto such a forma, in step 308, an appropriate background reference is added ,o 
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ft* message, such as through a background reference insertion process 3,2 an 
example of one implementation of wh,ch is shown in FIG. 5 and discussed below 

dehverytooneormoreenduserrecipients. In some embodiments and 
■mpiementationsofmepresentinvenhon, mis step includes sendmg and ac,ua, ly 
dehvenng me message to one more end users in user dependent formats 

^ground reference insertion process 312 of FIG. 4. The implementation of 
FIG. 5 ,s related to an advertisement system, but i, should be understood that the 
presentinvention includes inserting references to any type of background into end 
user messages. In addition, included in the scope of thepresen. invention are 
practically all techno.ogies through which a background, tiled or no. tiled on an 

mcludmg client-based solutions and future technologies for accomphshin, the ' 
desenbed functions. Nonetheless, i, should be clear tha, while the scope of the 
present invention is a.so intended ,„ include inserting a reference to any type of 
background image, graph,, etc., mduding non-advertisements, the method of 
mserung a reference to an advertisement is considered particularly useful and 
beneficial, as discussed above. 

According to the implementation of FIG. 5, it is firs, determined a, step 
404 whether the message already includes a background reference. While some 
embodiments of the present invention include determining if any type of 
backed reference is specified, including a mere designation of a co,or other 
embodiments .ncludecheckmg only for a designation of a separate image tile as a 
background. In addition, some embodiments will include making mis 
deterrmnation only for messages previously determined in step 306 to already be 
m a forma. 4a, can accept a background reference since such messages are more 
hkely ,o already include a background reference. If One message already includes 
a ackground reference, s,ep 406 de,emn„es if an approva. configuration specifies 
whether me background reference can be overwritten with a new background 
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reference. If the approval configuration indicate, that background references are 
no. to be overwritten for a particular message, step 412 mdica.es that the 
background reference tnsertton process 312 terminates without overwriting the 
extstmg background reference. An approva, configuration file is maintained in 
one embodiment of the present invention in order to enable end user recip.ents to 
configure the background reference system 1 55 (FIG. 3) on whether or not to 
overwrite existing background references in messages received by them. In other 
embodmrents, steps 404 and/or 406 are omitted, whereby there is automatic 
overwriting of all or no existing background references. Furthermore the 
ordenng of steps in the various flowcharts of the present invention are not 
mtended to limit the scope of the present invention with respect to order of 
operation since other embodiments include varying the orders of the steps As 
one example, in some embodiments, steps 404, 406 and 4.2 are instead executed 
after a message is received and before forma, determination is made in step 306 
In stall other embodiments, a general approval determination is included before 
format determination in order to determine if a particular end user recipient has 
approved any background reference insertions, regardless of whether any 
background references already exist. 

In accordance with the implementation shown in FIG. 5, when the 
background reference system 1 55 determines that an existing background 
reference may be overwritten in step 406, or if i, is determined mat there is no 
background reference specified in step 404, then further determinations are made 
as to which advertisement should be referenced by a new background reference to 
be mserted (or overwritten if already present) into the message. Based on a 
determmation in step 408, advertisements may be selected by the background 
reference system 155 baaed on available demographic information for a particular 
end user recipient (step 414) and/or on advertiser and advertisement exposures 
(step 416). In a web-based "free" e-mail implementation, acquisition of 
demographic information is required before the e-mail account is provided to a 
user. If demographic information is no. available or is otherwise inconclusive for 
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targeted advertisement, counts to advertisers may drive the selection from 
a pooi of available advertisers. Of course, as advertisements are seiected based on 
demographic categories or exposure requirements, records are maintained for 
nature selection and reporting putposes. There are many conventional 
demographic and advertisement poo, processmg systems currently avai.able and 

understoodbythosereasonablyskilled in the artofthe present invention 
Although only two types of advertisement seiection criteria have been discussed 
..should be understood mat other criteria can be used without departing from the 
spm, of the present invent™. Of course, advertisements shouid be constructed in 
color and design to no, interfere with end user recipients being ab.e to read the 
foreground message text. 

Once an appropriate advertisement has been selected in steps 414 or 4.6 a 
background reference to mat adverusemen, is inserted into the message a, step ' 
418. In one implementation of the present invention in HTML, a background tag 
such as <body background-Advertisement, is inserted into an HTML ' 
port.onofamessage.where-Advertisemen.Fi.e-isthenameofastored 
adverusemen, file. The advertisement file itself, often a graphical file is 
preferably no, transmitted with the message in some prefixed embedments of the 
■nvenfion, but is typically stored a, the message server or other location remote 
from the end user recipient, ft, web-based embodiments, the background file may 
be co-located, and in a similar stomge directory or folder, with the web page 
message or located remotely from the web page message. If the background file is 
co-located with the web page message in the same storage directory or folder the 
background reference need on,y include the name of the background file 
Otherwise, preamble directory names or foil URL addresses beginning with 
•http://www, etc., are necessary since the backed file can be located 
anywhere on the Web in some embedments. 

In some web-based embodiments where messages are stored on a network 
server after viewing by an end user recipient, the background reference insertion 
steps of the present invention are repeated each time the end user views the 
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message ,o show the end user a different background each time the message is 
™wed. In addttion, in other embodiments, regardless of whether those 
embodtments are web-based, the actual background fib referenced by the 
background reference is changed so that (he end user recipient vtews a afferent 
background when the message is viewed subsequently. In still other 
embodiments, the URL is no. an actual address of a known file, bu, a call to a 
separate server program, or scrip,, ,„ supp,y an unknown particular file chosen by 
the server program. Since the particular file supplied will automatically vary in 
some embodiments, end user recipients see different backgrounds each time the 
message is viewed. While apparently never havmg been associated with the 
.nsertionofbackgroundreferences into end user communication messages, some 
methods of calling a server program, or scrip,, for receiving an unknown 
parttcnlar file are conventional and would be understood by those reasonably 
stalled in the art of the present invention, and are included within the scope of the 
present invention. 

Some other embodiments include transmitting the advertisement file as an 
attachment along with the message for storage on an end user recipient 
workstation. Of course, configuration or knowledge of the end user recipient 
downloading location would be necessary (e.g., c:\downl„adfolder\) in 
constructing the proper address in the background reference rf ^ 
advertisement, which would only need to be downloaded once in embodiments 
ttackmg which advertisements are downloaded to which end user recipients and 
selectively sending on!y those advertisements tha, have no, previously been sen, 
to particular end user recipients. 

FIG. 6 shows an illustration of selected basic components of an example 
end user e-mail communication message as sen, by an end user originator in 
accordance with one preferred embodiment of the present invention. Additional 
conventional header information is no, shown for purposes of clarity, as is a,so 
often se,ec,ively me case with conventional e-mai, clients. Referring also back ,o 
FIG. 4, ,f a message represented by the example message of FIG. 6 is received in 
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step 304 of FIG. 4, it would be subsequently determmed in step 306 that the 
message is no. in fonnat that can accept a background reference since the message 
■s .n plain text Consequently, in step 308, the message wou!d be converted into 
an appropriate fonnat, such as HTML, an example of whtch is shown in FIG 7 
If, mstead, a message represented by FIG. 7 was initially received a. step 304 i e 
one which includes an HTML portion, as an example, i, would already be in an " 
appropriate format, and step 308 would not be executed. Subsequently as 
dtscussed above with respect to background reference insertion process 312 a 
background referee is mserted into the message, an examp,e of which is shown 
m FIG. 8. The example background reference shown in FIG. 8 is <body 
background="h«p://www,xampledomain.com/tkhr.ad.jp g ">. As discussed 
above, tn some web-baaed embodiments storing advertisements in the same 
dtrectory or folder as web page messages, the preamble can be omitted; thus in 
■he example shown in FIG. 8, the preamble '•http://www.exampledornain.oonV 
could then be omitted. 

FIG. 9 shows an illustration of a screen display of the example message of 
FIG. 8, where a tiled background image of a diagonal "www.tkhr.com" is shown 
as an example. Again, this image is not "clickable" since it is in the background 
of the screen, but e-mail messages and other end user communications can be 
branded, or watermarked, with virtuaUy any background image as shown, m one 
.mplementation of a web-based e-mai, system, the entire browser viewing area is 
used for displaying the message and background nnage, thus control buttons such 
as reply, rephy all, forward, delete, close, download attachment, etc. are on another 
screen and are accessible by a back button on abrowser, as is conventionally 
availaMemotherweb-basede-mailsystems. In another implementation the 
mformation shown in FIG. 9 is placed in a frame or table to share the browser 
v.ewmg area with one or more other frames and/or tables containing con«ro,s In 
ye. another implementation, control buttons and addttiona. information is inserted 
m.„ the message itself. Of course, traditional banner advertisements may still be 
displayed in addition to the background. 
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RefcrnowtotheFIG. .0, which is a flowchart showing genera, operation 

.epsSOOofanother parted e m hodi ni e Ilt o f thep reS e„, 1 „vc„,io„i„a„„ n .we b . 
based, SMTP/POP3 implementation of a background reference system 
accommodating an e-mail message with an attachment This examp.e is useful 
■ for end user recipients with MIME-compatible and HTML-compliant e-mail 
eta*. In the example shown, aflerreceiving a message in step 504 it is 
de.erm.ned if the message is in a conventional MIME forma, in step 506. In .his 
preferred embodiment, mis determination can be performed by searching the 
message for the tex, "MIME-Vcion", for example, in a header field. Although 

■s „ the search criteria in this preferred embodiment, i, should be understood 
tha me scope of the present invention includes any search criteria that may be 

identifying whether a message is MIME formatted. If the message is not 
m a MIME forma,, it is checked for attachment tncluded wi.hin , he « of me 
message and converted in,o a MIME forma, in step 908. One such type of 
attachment is the conventional UUENCODED attachment, which is delineated by 
keyword, , "begin" and -end"; hence, ^ , his preferred e m bod.men,, me message is 
checked forcharacerisficplacememofmese keywords. Once converted the 
message will include a "MIME-Version" header field, and any attachment will be 
converted intoaMIMB attachment portion. One example attachment common 
process mcludes converting from UUENCODE to base64, which is we,, defined 
and documented in Request for Comments (RFC) 2045, wh,ch is considered 
understoodbythose skilled in the art of the present mventton and which is herein 
mcorporated by reference. The converted attachments win be added as parts to 
tte message, including me additton of separators as discussed in more detail in 

Next, a MIME mttitipart/alternative part with HTML is added in step 5.0 
The multipart/alternative designation offers an alternative version of me tex, of ' 
the message such that clients that support HTML can display it, and clients that do 
no, can show the Cher alternative, which is usually p Iain text . The HTML part is 
essentially an HTML version of me e-mail message, me conversion ,o which 
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wou,d be understood by those reasonaWy skilled i"„ the art of the present invention 
as stmtlar to that discussed above with respect to step 308 (FIG 4) If the 
message recetved in step 506 is already in a MIME format, i, is determmed in step 
5U whether the message already contains an HTML part, such as through 
searchmg for an appropriately located string "text/html" If „ ot , step 5 , 0 is 
executed as discussed previously. If so> „ wdl as af(er step , ,„ js M[j fa ^ 
other two circumstances discussed previous*, a background reference insertion 
process is executed in step 512, which is simiiar to the background reference 
msertion process 3,2 shown in FIG. 5. As with the embodiment discussed in 
FIGS. 4 and 5, the ordering of steps is changed in other embodiments, and 
prevtous determinations may affect subsequent determinations. For examp le if i, 
- known through steps 508 or 511 that the message does not contain an HTML 
par,, steps 404, 406, a*d 412 need not be executed since it would already be 
known that no background reference is specified. 

FIG. 1 1 is an illustration of selected basic components of an example end 
user e-matl communication message that is not in MIME fonnat and that has an 
attachment, in accordance with the prefetred embodiment of FIG. 10. The 
attachment, "clouds.bmp", is shown in a UUENCODED format between and 
mcluding, me words "begin" and "end." FIG. 12 is an illustration of an example 
message similar to that of FIG. 1 1 converted into MIME format with the 
attachment in base64 encoding. FIG. ,3 is an illustration of an example message 
stmilarto that of FIG. .2 converted into a multipart/alternative part MIME forma, 
wtth an HTML par, including a background reference. The HTML part begins 
wtth <HTML> and ends with </HTML>, a„ d ^ examp|e backgromd 

» shown as <bodybackgro U1 d="h« p: //www.examp,edomai„.com/,khrad. j pg> 
In an HTML-compatible, MIME-complian. e-mail client, the "c.ouds bmp" 
attachment would be downloaded to the end user recipient's workstation, and the 
e-matl message would be displayed with a tiled background of the image file 
located at the referenced address. The "clouds.bmp" file is no, mtended to be the 
background file in this preferred embodiment, but as discussed above otter 
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embodunents include sending the background file along as an attachment to the 
message. Thus, if the "clouds.bmp" file were the intended background file, and if 

were known that the download directory on the end user recipient workstation 
waa "c:\download", men the background reference would be simtlar to <body 
background="c:\download\clouds.jpg">. 

Refer now to FIG. .4, winch is an object model diagram 500 showing 
porhons of one implementation of an advertising system in accordance with one 
preferred embodiment of the present invention. The method employed by the 
dtagram 600, also known as a Rose model, is a unified modeling language 
(UML), a standard^ way of representing objects and their relationships to each 
other. In the diagram 600, a hollow arrow "inherits" (a first object inherits from a 
second object if tine firs, object takes on the properties and behavior of the second 
object, ,e., the firs, object contains the properties and methods of the second 
object), a dotted line with an arrow is a dependency (using an object internally or 
dunng a function call as a parame.er) and a straight solid line is an "association" 
(usmg an object internally without exposing it). Boxes shown in the diagram are 
object classes, which include member variables and methods. The letter "Z" 
merely signifies that the element is an object, i.e., standing for "the." 

Thus, a ZVendorSpecificEmaillnterface 610 inherits from a 
ZEMaillnterfaceBase 612; a ZVendorSpeeificDemographicInterface 614 inherits 

fromaZDemo g raphicIn.erfaceBaae6.6 ; ZVe„d 0 rSpecificApprovalIn,erface6.8 
mhems from a ZApprovallnterfaceBase 620; and a ZHTMLEMail 622 inherits 
from bo,h a ZEMatiBase 624 and a string 626. A ZWatermarker 628 has a 
dependency on the ZEMaillnterfaceBase 6.2, the ZDemographicInterfaceBase 
616, and the ZApprovallnterfaceBase 620, as well as an association with the 
ZHTMLEMail 622 and the ZEMailBase 624. The ZEMaillnterfaceBase 612 also 
has dependencies on the ZHTMLEMail 622 and the ZEMailBase 624 The 
ZEMailBase 624 has dependencies on the string 626 and a ZAttachmen, 632 as 
well as associations with a lis,<S,ring> 630 and a lis.<ZAt,achment> 634 bod, of 
whrch are aggregates of a lisKTypo 636 and themselves have dependencies on 
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620ha3adep ai denc y onthe2 E MailBa Se 624.T ll el i s t <T y pe>636isa.e m p,a t e 
class corresponding to a standard template Hbrary for dynamic compilation A 
.empiateclasstsaclass which, at compiie time, takes parameters passed to i, and 
replaces those parameters interna,*. The ZEMarlBase 624 contains Zattachmen. 
632 and string 626 to store its contents. 

Member variables and methods for the objects of FIG. 14includethe 
Mowing, with colons meaning "type" for msmias md .. retum for 
methods: 



ZAttachmen. f>~ki 

MEMBERS 

m_ulLength : Long = 0 

m_pBinaryData : void * = NULL 
m_Name : String = "" 
METHODS 
ZAttachment () 
GetData () : void* 

PutData (pData : void* = default, IDataLength : long = default) : 
enumSuccessError 



ZEMailBasp fO± 
MEMBERS 

m_RecipientList : list<String> 
m_CarbonCopyList : list<String> 
m_Date : Date 
m_sSender : String 
m_sSubject : String 
m_sBody : String 

m_AttachmentList : list<ZAttachment> 
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m_lReferenceID : Long = 0 
m_sMailBoxName : String 
METHODS 

GetRecipientCount () : Long 

GetRecipient (lindex : Long) : String 

GetCarbonCopyCount () : Long 

GetCarbonCopy (lindex : Long) : String 

GetDate () : Date 
GetSender () : String 
GetSubject () : String 
GetBodyO: String 
GetAttachmentCount () : Long 
GetAttachment () : ZAttachment 
GetReferencelD () : Long 
GetMailBoxName () : String 

ZHTMLEMaij ftr) 
METHODS 

ZHTMLEMail (EMailBaseToCopy : ZEMailBase&) 

Construct (EMailBaseToCopy : ZEMailBase&) : enumSuccessError 

AddBackground (sBackgroundReference : String) : enumSuccessError 

ZWatermar1fprfi9g 
MEMBERS 

mjjEMaillnterfaceBase : ZEMaillnterfaceBase * = NULL 
m^DemographicIInterface : ZDemographicInterface * = NULL 
m_pApprovalInterface : ZApprovallnterfaceBase * = NULL 
METHODS 

PutEmaillnterface (pEMailUnterface : ZEMailllnterfaceBase *) : 
enumSuccessError 



PmDemograpMcInterface (pDe^graphicWaJ: ZDe.ograpWcIn.erfaceBase 

*) : enumSuccessError 
Pu.ApprovaUn.erface (pDemographicInterface : ZApprovalln.erfaceBase • = 

default) : enumSuccessError 
ProcessEMail (IReferencelD : Long) : enumSuccessError 
ConvertEMail () : enumSuccessError 

ZEMailTnterfar P Ra Sr 61 2 
METHODS 

Register (pWatermarker : ZWatermarker*) : enumSuccessError 

GetEMail (IReferencelD : DataType) : ZEMailBase 

PutEMail (HTMLEMail : ZHTMLEMail&) : enumSuccessError 

ZDemographiVTnt^ r f a ceBase fi1fi 
METHOD 

GetBackgroundReference (MailBoxName : String) : String 

ZApprova1TnterfWpf,o P ^ 0 
METHOD 

IsApproved (rEMailBase : const ZEMailBase& = default) : BOOL 

Each of the vendor specific objects, including 
ZVendorSpeancEmaillnterface 610, ZVendorSpec 1 f 1 cDemogra P h 1 cInterface 614 
and ZVendorSpecificApprovallnterface 618, are constructed to interface with ' 
specific vendor systems. Thus, such objects maybe mterchanged and used as 
necessary when working with different systems. Furthemore, the 
ZVendorSpecificEmaillnterface 610 is replaced with a 

ZVendorSpecificNewsgroupInterface for NNTP interfacing, as well as any other 
type of end user messaging system needed. 
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Refer aiso «o FIG. , 5, which is a flowchart showing a configuration 

P-ess 7 00offl 1 eadver«isin 8 s y ,e m i mpl e m e„taflonpo I tion representee byFIG 
14. When configuration process 700 software is compfled, a determmation is 
-de regarding the operating system environ™,, snch as Windows or Unix 
After tha, determination is made, the compfled software runs according to the 
operanng system distinctions shown, bu, the determination is made only once 
Thus, after i, is determined tha, Unix or Windows is the operating envtronmen, 
foraparttcuiar implementation, all of the iliustrated operating system 

700 starts ,„ step 702,amanua, process, ifUnix is the operating system, three 
daemons are manually started in steps 706, 708, and 7, 0, including a vendor 

specific emailinterfacedaemon.avendorspecficdemographicmterfacedaemon 
and a vendor specific approval interface daemon, respectively 

712. The watermarker container program then instantiates, creates an instanceof 
ZWa,ermarker628 instep7,4. Subsequently, in step 7,6, the watermarker ' 
contamer program creates an instanceof the ZEMaillnterfaceBase 6,2 after 
wbach either a vendor specific EMaillnterface DLL is loaded (step 72 0 | or 

722), dependmg on tire operating system in which the process 700 software is 
compfled, as discussed above. Then, in step 724, the watermarker container 
program creates an --e of the ZApprovaflnterfaceBaae 620, after which eitirer 
avendorspec 1 ficApprova, te erfaceDLL 1 s,oadcd ( s,ep72 8) orconm,unica,ion 
- estabhshed to a vendor specific Approvallnterface daemon (step 730) 
dependingon the operating systen, in which the process 700 software is compfled 
asdtscussedabove. ft, step 732, me watermarker confer program creates an ' 
mstance of the ZDetnographicftflerfaceBase 6, 6, after which either a vendor 
specfic Demographicftflerface DLL is loaded (step 736) or communication is 
estabhshedtoavendor specific Demographidn.erface daemon (step 738) 
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depending on the operating system in which the process 700 software is compi.ed 
as discussed above. 

The watermarker container program then passes the 
ZApprovaUnterfaceBase 620,o the ZWatermarker 628 in step 740, which ca„s 
me PutApprovaltoterface method in the ZWatermarker 628. The watermarker 
container program passes the ZEMaillnterfaceBase 612 to the ZWatermarker 628 
m*p 742, which cans •hePn,EMai,mterfacemeti 10 di n theZWa,e I ma r ker628 
wh,ch then prompts the ZWatermarker 628, in step 744 tocall 
ZEMaiUnterfaceBase.Register to enable the ZEMaiilnterfaceBase 6.2 to trigger 
work. to5tep746,,hewa,ermarkercontainerprogrampassesfte 
ZDemographicI„terfaceBase616,o,heZWa,ermarker 628, which ca„s the 
Pu.Demographicmterfacememodin«heZWate m arker628.AImo Ug h,he 
watermarker container prog™ is men fntished initiaiizing, the process 700 waits 
m step 748 for me ZEMatilnterfaceBase 6! 2 to tiigger work in response to 
receiving an e-mail message as discussed below. 

Refer also to FIG. . 6, which is a flowchart showing selected e-mail 

by FIG. 14. After an e-mail message is received in step 802, though the 
ZVendorSpecificEmaillnterface 6.0, the ZEMaillnterfaceBase 612 cal.s in step 
804, the ZWatermarker::ProcessEmai, method in the ZWatermarker 628 with an 
EMail reference ID (identification number). Step 802 may inc.ude being notified 
by an external brand-specific e-mail server program through me 
^endorSpecificEmaillnterfaceS^thatanew e-mail message is in a particular 
matibox. m other embodiments, the ZVendorSpecificEmaiilnterface 6,0 pons the 
external e-mail server program to determine when a new e-mail message is 
available. When the ZWatermarker 628 is avai.ab.e in step 806, itretneves the e- 
mad message from the ZEMaillnterfaceBase 612 as a ZEMaiiBase 624 object 
using the previously supplied reference ID. The ZEMaiiBase 624 is a data 
container mat parses the received e-mai, message so that the ZWatermarker 628 
can operate on e-mai, messages regard.ess of fonnat. Subsequently, in step 808 
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the ZWatermarker 628 passes .he ZEMatlBase 624 object to the 

^~^=Ba S e:IsApp ro ve4 m ethodof ft eZApp ro vaII„,e rf aceBase620 
wh,ch examines the ZEMatlBase 624 object to deternnne if fitter processing is ' 
necessary, as determined by a separate approval system with which the 
ZVendorSpecificApprovaHnterface 6,8 interfaces. As discussed above this 
separate approval functions in accordance with an approva, configuration 
for each enduserrecipient which, » some eu.bodhnen^ determines if an existh.g 
bac kg roundrefere„cee x is,sand 1 fi,is t obeove lwi , ten . 
ceriam users may be configured to have an background references overwritten ' 
and ,„ other embodiments, the insertion of background references is approved " 
based on other demography or message content factors. As determined in 
'™«p8.0,i^^ 
fa.se, the process 800 essentially tenrnna.es and waits for another incoming e-mai, 
message m step 812. Otherwise, processing continues in step 814 

Id step 8,4, the ZWatermarker 628 retrieves me MailBoxName from me 

ZEMa 1 ,Base624oh j ec,.Subse q uen«.y,i„s,ep8,6,meZWa,ermarker628heg i „s 
the process of obtaining an appropriate background reference by calling the 

ZDemographtcInterfaceBascGetBackgroundReferencemethodofthe 

18,separa,e demographic software, to which an interface isprovtded through 
ZVendorSpecificDemographicInterface 614, determines me appropriate 

background reference for the supplied MaiBoxName. In step 820 the 
ZWatermarker 628 converts the ZEMai,Base 624 object to a ZHTMLEMai, 622 
object with a provided copy constructor. Since the ZHTMLEMail 622 inherits 
from the ZEMailBase 624, the ZHTMLEMail 622 has access to all of the data and 
structure of the ZHTMLEMail 622 object for making an HTML copy. As 
dtscussed above, conversion to HTML includes a complete conversion for web- 
hased applicattons, and conversion of a portion of the e-mai. message for non- 
web-based apphcations. In addition, attachments are a,so hand,ed a, mis point as 
dtscussed above, as we,, as the creafion of contro, buttons for genera, controland 
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for downloading any attachments through server scripting in web-based 
apphcations. Then, in step 822, the ZWatermarker 628 calls the 
ZHTMLEMaih.AddBackground tnethod of the ZHTMLEMail 622 with the 
appropriate background reference, which is inserted into theHTMLof the 
ZHTMLEMail 622 object. Jn step 824, the ZWatermarker 628 retu m s the newlv 

format.edZHTMLEMa.ltofteZEMa.ilnterfaeeBasebyeahingdtePutEn.a,, 
method, which includes placing the ZHTMLEMail 622 object in an appropriate 
Place for malting the message availab.e for delivery to an end user recipient 
Subsequent,* the process 800 waits for the next e-mail message in step 812 
In otherembodimentsof thepresen. invention, the Recipients, and 
CarbonCopyLis,variahlesof m eZEMailBa S e624„b j ect for each e-mai, message 
are used to generate associational demographic information. In other words 
marketing conc.nsions can be drawn about other primary recipients and carbon 
copyrecipients based on demographic information of one intended end user 
recptent. Thus, mis information is useful and easily tracked and reported in 
accordance with the present invention. 

In concluding the detailed description, i, should be noted that it will be 
obvious to those skihed in the art that many variations and modifications can be 
made to the preferred embodiment without substantially departing from the 
pnncples of the present invention. Al, such variations and modifications are 
mtendedto be included herein within the scope of the present invention, asset 
forth m the following claims. 



